A recent research paper revealed a new way to help AI models ingest way more data. Soon, you'll be able to put millions of words into context windows of AI models, researchers say. Bigger AI models can handle more, but only up to about 75,000. Massive context windowsThis Ring Attention method means that we should be able to put millions of words into the context windows of AI models, not just tens of thousands. AdvertisementAdvertisementThis chart shows some of the results of tests from the "Ring Attention" AI research paper.

---

Persons: you'll, —, Matei Zaharia, Pieter Abbeel, Claude, That's, OpenAI's, Hao Liu, Liu Organizations: Service, Google, UC Berkeley, Databricks, Nvidia Locations: GPT